Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System

نویسندگان

چکیده

Taskflow aims to streamline the building of parallel and heterogeneous applications using a lightweight task graph-based approach. introduces an expressive graph programming model assist developers in implementation decomposition strategies on computing platform. Our distinguishes itself as very general class parallelism with in-graph control flow enable end-to-end optimization. To support our high performance, we design efficient system runtime that solves many new scheduling challenges arising out models optimizes performance across latency, energy efficiency, throughput. We have demonstrated promising real-world applications. As example, large-scale machine learning workload up 29% faster, 1.5× less memory, 1.9× higher throughput than industrial system, oneTBB, 40 CPUs 4 GPUs. opened source deployed it large numbers users open-source community.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A survey on task scheduling for heterogeneous parallel computing environments

Network computing environments with heterogeneous computers have emerged as results of speedups of computer networks, and needs of parallelization technologies for heterogeneous parallel computing environments are increasing. This paper surveys scheduling algorithms, which are the major issue of parallelization in the task parallel paradigm, for heterogeneous parallel computing environments. Th...

متن کامل

Simulation of Task Graph Systems in Heterogeneous Computing Environments

This paper describes a simulation tool for the analysis of complex jobs described in the form of task graphs. The simulation procedure relies on the PN-based topological representation of the task graph that takes advantage of directly modeling precedence constraints and other characteristics inherent in Generalized Stochastic Petri Nets (GSPN). The GSPN representation is enhanced with enabling...

متن کامل

A Pluggable Framework for Lightweight Task Offloading in Parallel and Distributed Computing

Multicore processors have quickly become ubiquitous in supercomputing, cluster computing, datacenter computing, and even personal computing. Software advances, however, continue to lag behind. In the past, software designers could simply rely on clock-speed increases to improve the performance of their software. With clock speeds now stagnant, software designers need to tap into the increased h...

متن کامل

Heterogeneous parallel and distributed computing

Heterogeneous network-based distributed and parallel computing is gaining increasing acceptance as an alternative or complementary paradigm to multiprocessor-based parallel processing as well as to conventional supercomputing. While algorithmic and programming aspects of heterogeneous concurrent computing are similar to their parallel processing counterparts, system issues, partitioning and sch...

متن کامل

A Lightweight Task Graph Scheduler for Distributed High-Performance Scientific Computing

The continually growing demand for increased simulation complexity introduces the need for scientific software frameworks to parallelize simulation tasks. We present our approach for a task graph scheduler based on modern programming techniques. The scheduler utilizes the Message Passing Interface to distribute the tasks among distributed computing nodes. We show that our approach does not only...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Parallel and Distributed Systems

سال: 2022

ISSN: ['1045-9219', '1558-2183', '2161-9883']

DOI: https://doi.org/10.1109/tpds.2021.3104255